Jackey J. K. Chai

Project Title

Simulation and Perception of Physically-based Collisions in Mixed Reality Applications

Supervision Team

Carol O’Sullivan, TCD / Brendan Rooney, UCD

Description

In this project, we will research new methods for simulating collisions and contacts between objects that move according to the laws of physics, when one of those objects is real and the other one virtual (e.g., virtual ball bouncing on a real table, or vice versa). We will also explore the factors that affect the perception of physically based interactions between real and virtual objects (both rigid and deformable). Multisensory (i.e., vision, sound, touch) simulation models of physically plausible interactions will be developed, using captured data and machine learning (ML) and driven by our new perceptual metrics. Our real-time simulations will be applied in Mixed Reality (MR) environments, which will be displayed using a variety of technologies, including the MS Hololens, projection-based MR and hand-held devices.